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ABSTRACT ' . 

Interest in mathemagenics (adjunct aids used in text 
to-enhance learning) has most likely 1 resulted from the indirect 
effects .of inserted postquest ions , whereby the learning of 
unquestioned material is enhanced as well as that of questioned 
material/ 'However, since most mathemagenics research has occurred in* 
laboratory settings in which subjects were prevented from turning . 
.badk» to a text r segment once they had encountered a. postquest ion / the 
effects of mathemagenics in naturalistic settings remain .problematic. 
A study was conducted to' examine the nature of the nonreview 
donstraints and /to compare the results to those obtained in a . 
naturalistic getting in which'review was allowed. Subjects were 99 \ 
secondary school students who were placed in either an experimental 
. (f.evieW) or a control group (nonreview) and given a 1,700 word 
'passage; to read. Those passages used by the control* groups did not 
£ontai.n in&ferted questions; however ^thes.e 'subjects were told that 
they w#Uld be asked to .recall as much as possible about the passage 
.after, reading;. All subjects were given ( f ree recall and cued recall 
te^sts following the 'experiment.- Results showed that, contrary to 
expectations, relevant learning wa^s* not enhanced by inserted • 
questions in the text. In addition, incidental learning was also 
slightly depressed by %hg use of inserted questions.; This was tr.ue- 
tor both rey-iew and nonreview groups^ (Materials used in the study 
are appended.) (FL) \ ^„ , « 
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MATUgMAGKNICS AND REVIEW CONSTRAINTS ' , . 



\. The term 'mathemagenics 1 covers ±he full Grange of adjunct aids wlifi ch 



can t)f» employed in textual situations to enhance learning, although iij|is 
known primarily for the use of adjunct questions inserted in text.. Mafthe- 
magenics is a well established area of educational research, with alij-Jady 
on extensive literature and aCgood number of reviews (cf. Duchastol , . jt978) * 

to consolidate 1 its findings. ^ P i 

' '/ \ . * ... - j 

Most of tyie interest in mathen»agenics has most likely resulted [from 

- * * Y < * I 

We ind^rept effects of inserted postquestions, whereby the learringfof 



"i 

f 

unquestioned material is enhanced as well as that of questioned material; 



although to a lesser^ extent. In other words, .all textual material* ban be 
better leaVnod even thougfr<the inserted questions themselves can only cover 
Certain part's of the material (cf. Rothkopf, j976, for a ropent 'review) . 
While thj^ conclusion may have some trouble generalising from low Revels to 
high levels of* learning, (Rickards, 1977)" and : while the«eff«ct piay be 
feiightlj/ confounded by time tf (Faw and Valder", 1976) ^^thou^h probably very 

slightly if at. u^l , the effect does appear per^^s^ent and is generaily ack- 

'' . * ' ' , * * > * • ' ; 

nowl edg<ed. ■ ^ %i \ . 

• * 
• ^Wh&t remains problematic, however, is the external validity of the 

• • > . • - % • 

effect. Pat directly, the question is to what fextent the effect will hold 

x • * 

up in na-turaJ.i st4 c settings. Practical advice to instructional designers 

v ' * " :v . J ' ■ • \ ■ ' - * 

which.. is i>aseJ oji the literature of inserted q^Stions must bev tempered 
wi±h caution (Duchastel 197&). * » \." . 

The reason, for this state of affairs Is the lack of congruence between 
the experimental 'paradigm underlying most of the literature and learning t 

^ 1 • • - ' ' / v 1 

strategics adopter in *na_turaldstic settings* ^ndeed most experiments m 
which' inserted postquestions were examined prevented, the students fr.om turn- 
ing oack to a ^previous text segment once- a postquestiop was encotintered. 



This \ i uiul'M .standablo, since if the students woi e allowed to look 
bark, rpu«-tions nitjht well, in fact , h«Toim> pio-ievio'w qrfosXion^. if not 
oiitijuiht pt e--quo^tions. * - 

The unnatin alnoss of this is unsettling, for few practical sotting- 
emh >d\ i^e ^iMniontin] stud\ constraint imposed in the ov t ><M inionts. Thu^. 
while th" induoct '^iVct of inserted post questions may bo very real, it 
remains plausible that wo are dealing with an effect created in the Jahot- 
atory, with only the most tenuous connection to t h^ outside world. The 
ismio is thus, opo of some importance, 

Tlu op previous studies known to me have relaxed the non-review con- 
straint. One of thom was the very first study in the area, by Washbur no , 
(V)2<)) who found <f U inserted pos tquest i ons generally increased questioned 
learning onlv .it th- expense of unquestioned learning. Tfie second study, 
b\ Gust^i^nn auk] Toole (1970), found postquest ions to enhance questioned 
learning and not to affect unquestioned learning either way (no enhancement 
nor any suppression). The third study,*, by Hitler ( 197'* )i. examined only the 
effects 0/ ru stquostioris on unquestioned learning and found that^gt tini^s 
th<>y def>r » r <=-od this t\po of learning. This effect, however, interacted 
with qiitt'iion difficulty and disappeared on a retention tost two wock« later. 

iv '.im..th^ thrt-e studios which relaxed the usual noiwovru urn? hainl 

fa j If d to foll'Hv the I est ol the research "J i terature in ioportuig enhanced 

unquepl ; ntv d h iW-niivj and at times found effects opposite to the usual ono.s 

(suppi r r. c ion of thi s * learning) alono the linos of a selective learning model. 

# y 

The' piu pose of the present study io to dit e^tly 1 examine the natuie of these 
el fect«* l»v comparing a review condition t' .1 non-review one* and by exanunuiq 
the diiertion and ge no ralitv of the effects (rf. Rickaids, 197fi). * 



/ 



METHOD 

V 



Mat 01 ia I s 



The I (Mining passant employed* in t ho t udy was dov e 1 oped by the a 

author. The 1700-word pas^uao enfitlod 'Tho Victor i,»n Fra 1 , contained 

12 topicol paragraphs, oach dealing with a separate topic involved 

in tin: period of British historv covorod by tho reign of Quern Victoria 
i » , 

( 1837" l'JO 0 • The t^x t a I so con tainod in introduction and a"' cone 1 us ion 

which were simply meant to frame the context of the passage; however 

on I y roc of the 12 topical paragraphs wa« examined later in the stud- 

onts 1 protocol^. A typical para^rnph /i o 1 1 ows : 

"A f°w v^ars later took place the' Groat Exhibition of 1 B S 1 - It 

was an idea thouqht up by Prince Albert and it brouciht together under 

one roof numerous displays of industrial achievement from Britain and 

other countries. Those uoro all housed in a very large glass hall called 

Ciystal Palace which was built in Hyde Park. Many years later % unf or tun- 

nt'»ly, tlu^ Palace burnt to the ground. It was a grand sight in its xlay^, 

however. Some days the eritry fee was five shillings and it is then Miat 

the nrVt'ir ri< and the rich wont to visit it. On other days, the fee 

w.is only one .hilling and the crowds poured ljn from evoiy part of the 

country. Many of the oxhibLts wore later pn sorve-d Mn a new museum which 
k 

wa«s called the Victoria and Albert Museum. 

Tie 12 topics presented in Urn passage were the fallowing, in their 
c 

ord< r of .appearance : Prince Albert; the Corn Laws; the Gi ^at Exhibition. 

t ' 

the Crim* an War: the charming rol,c of "women; India; Lj v irigstone ; tho 
S\uz Canal; Trish Home ,Ru ! <* } the Queen's Jubil"<\s; Trade-Unionism; the 
IV)' 1 W«r., , * 1 



* The' pa «sage is largely based o\n the account nf the period given in 
Hurk*-*5 \n Illustrated History ol Ln gl and ( 1 97'* ) • The pas^aye whs written 
in such a way that it could be easily understood by, the 15 yearrold stud- 
ents taking part in the study. *' * ' * 



Th^. experiment involved a 2 x 2 design. .(Question^ x Review) with 
• / • e ) 

23 to 26 subjects >^ cell. Six of the twelve topical paVagraphs in' 

the passage were each followed*by s two inserted post-questions- while the 

other six were not. Thus, repeated measures analyses qomparing question 

sots wQfe al» made possible. Questioned and unquestioned paragraphs 

3 . • • ' 

weTre sequenced in" a mixed order so that the students wou^ld not guess 
•after a while which of the paragraphs would be querstioned(as migrd; ,be 
•the case if only alternate paragraphs were que3tioned). The" inserted 
questions wer^placed at the top of the page which followed their rel- 
evant paragraph. 

Directions to half of the ^students indicated to them that once' 
they had turned' a page of the^passage, they were no"1r-allowed to turn * 

' * * 1 \ 

' back and_ilook at it again. The pthe£ half of the students were told 
_(in their directions) °that they^were a^Jrowed torturn fcack to the pre- 
1 vious page if they ""wanted to before going *on. This is what constituted* 
. " the Review manipulation in- this study. 

* 'The experiment also involved two control ' groups which ^tudied a 

version. of the text which contained no inserted questions. These 

° c * • * 

-groups w£re included in order to establish appropriate recall base- 

lines. One of the ct>ntfo<l ^roTTjp^-was allowed immexlip^te^review (review 

of the previous ^page)', while the other was not. IT shoulch be noted 

tljiat in neither of the experimental or control conditions were the 

student^ allowed to review the whole text after it had been read once. 



* The subjects wdre 99 secondary school students in a British conir 
prehensive school. They were on the whole, lk or 15 years old.. The 



"numbed of subjects in *the experimental and .control groupfe w<*r^ a$prox- 
- imately equal. * - * * 



" Posttcsts * 

■ ■ V 

Two tests were developed for the passage, in order to reveal diff- 

erent^aspects of learning. These were as follows, in order^f presenta- 



tion: 



^Tojjical free" recall: the students were' asked to recall the 
12 major events presented in the passage ^ and tp^l is t th?m in • 
a few words each. " * N 

r , • 

Cued free recall: this consisted qf 36 expl ici t questions^ 

requiring the student to provide an idea or a detail from the 

passage.* The following is a . sampi e^question : \ 

"Who first thought of the' Great Exhibition? u This tost was 

made up as .follows: (i) the 12 interns seen previously in the. 

inserted questi&n* condition; (ii) 12 n£w~i$e\s related *to the 

* %. < 

6 questioned paragraphs; and (iii) 12 items unrelated to the 

" ~ ' - ~ T?J ' - ' 
questioned paragraphs (and hence related to the unquestioned 

paragraphs). The items were not set out in blocks of 12 on the 

' • * v ' . 

tost, but rather followed "the order of occurrence of events -in ' 

the passage. - 4 ' „ ' 



Procedure 
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The" study was conducted with twoV groups of students during regular 



class time. In each gsoup the students We randomly assignee! to the 
four cells in the design by random allocation of^he materials, which 
were contained in brown manilla envelopes. Written instructions Intro- 
duced the' students .to t^e task and indicated to them that they would 
* later be asked to write down the main points that they could^remember , 

and tflat they wou^r-be ask^d specif i6 questions of detail as Wfll. * 
< v ' " * . ' ' ' * .> ' 

Th* instructions for the^students in the inserted questions l^Rdit- 



• ion lndi^pcoa to tnem toot" *i ymj) lo snBTTOl 1 ttttr quub b-ftms; Ltw.jp cmcptirrtcrgri 

■ • . / 7 

/ 



N 



in the text would he] p thorn find out whether they could remember the 

ideas in the* text as they, reacj it. The instructions concerning the 

review/non-^review conditions were explained above in the Design section. 

Time was also a factor in this study. The students, when. finish- 

mg reading the text, wrote down in a box provided at the end of the 
<» • 

text the "number which appeared on a chart at the front of the hall where 

the experiment toofc place. This figure was the number of elapsed minutes 

« 

^ since the start of the study phase and it was updated every minute tby the 
^xperimer\ter. 

The students were given- a maximum of 15 minutes in which to read 

the text, ^fter, wh'ich timo they proceeded to the posttests. The st'udonts 

\ ' 

had ample time to respond to each of these tes'ts. % f 

. \ The tests were corrected in a blind manner, whereby the person corr- 

c J 
ecting \,he tests (a research assistant) was not aware of the group ident- 

ity of the pupils as $he exsfmmed their answers. \ \ s 

' ' ^ RESULTS AND DISCUSSIONS* 

^ ■ ' * 

The mean scores obtained, on the various subtests used as ^ell as the » 

mean time of* study are presented by group in Table 1 a . The non-review con- 
* - * \ < * « 

dition groups (right-hand side of the Table) represent the classical • « 

^e^erimentaJ^groups utilij^d in mathemagenic ^research. Unfortunately, tho 

results obtained under this .condition in -the present.jfctudy fa'il to . 

replicate the usuaT results obtained in the literature on inserjbed questions. 

f ♦ ...... 

.Thus, pontrary to expectation, relevant learning (scores for questioned • 
topics and repeated^ questions) was not enhanced by the fact- that the students 
encountered inserted questions in the text. Al so 'cc-ntrary" to expectation, 
incidental learning was slightly depressed rather ^than enhanced by 'j^heu * 

.•provision of inserted questions. ' Incidental Teaming corresponds here to 



the scares for unquestioned topics and ^for* unrelated questions. 
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TABLE 1 



Memis of the f Test SMbscores and Mean Time for Each of the Four Groups. ' 



• 


Review 


conai t l on 


Non—Revi e.w 


Condi t ion 


1 

1 


. insertea 
Questions 


Questions 


j 

x nseriea 
Questions 


no 

Questions 


< 


N = 26 


N = 25 


N = 25 


l^a 23 . 


Topical test 








» 


Questioned topics 


4.7 


4.2 


4.1 


3.9 


Unquestioned topics 


2.7 




2.9 


3.6 


Total 


7-3 


7-8. 


7-0 


7.5 

j 


Cued-recall test 








■ 


Repeated questions 
Related questions 


8'. 3 

• 

7 Q 


8.1 

• > 

7 ^ 
f O 


r. 4 

7 9 

l 


7.4 

7 1 * 


Unrelated questions 


, 5.2 ' 


5-1 


4.7 


5-6 • 


Total* 


21.5 


20.7 ' 


19-2 


20. 1 


Time 


12.9 


1 ■ r ' 

"12.8 


■ 13.6, . 


12.6 ' • 






\ 
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The condition groups in which review was permitted (left-hand side 
« v ' 

of the Table) display results which parallel tho5;e just ^presented : 

■ * * • 

( *reievant learning is not substantially* enhanced , and incidental learning 
is either unaffected by the inserted questions (on .the cued recall test) 
"or slightly depressed (on the topical test) as in the *non-review condition. 
Time means are generally consistent^ across groups with the highest 
™ t^ime mean occurring in the non-review/insorted questions group. 

i 

The intention of this study was 'to examine how the review constraints 

nan^l'ly imposed in this type of rese arch compare in terms results with 

/ - . ^ 

a variation of the constraints which more closely 'approximates; to real study 

V • 9 



settings, ^hewev^r, because the non-review condition in this study failed 
to replicate tire usual pattern of results encountered traditionally, 
little can ^>q said concerning variations from this condition. To be able 



to do that, one would have to have* Jifcst-replicated the traditional 

results in the non-review condition, further analyses based o*n the proscn 
* « ■ * • 

« set of data would be misleading. 

- ' ' ' . ' [ 

Consideration of the procedures involved in the study or of the 
materials employed give little indication of the underlying reasons for 
which the usual results have not "been obtained. The students did seem to 
take the task seriously and, as far as can be gauged, to have followed the 
K directions provided to them. The strategies' which were involved in the 
treatments were under "their control, but the'main variable 1 of concern here 
namely the i>rovisjLo*n or ndt of inserted questions, was not. 

The scori 

j 

answers to some of the questions were at times dif f iculti^to evaluate 
because of the particular way the answers were put. This 4 is a hazard 
cojjjmon to most free recall scoring situations and it may account -to some 

r 

/degree* for the results " obtained. It is possible in other word£ that thc\ 

reliability or validity of^ the scoring, procedures may hav^ been wanting. 

^ In conclusion, the main .hypotheses developed for this study were 

unabie to be verified because the condition, in the study which was^to 

s(^rve as a baseline of sorts for the comparispns failed ta replicate in 

i - * 

terms of results the traditional findings in the field. .It is felt that 

the problem suggested in this paper is still one which needs to be 

examined, only in a way which will first provide the expected replication^ 



-ing of^the nwtocols did present problems in that the' 



of the' classical paradigm. 
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EDUCATIONAL RESEARCH STUDY-II * 

a, * * 

* . DIRECTIONS * „ 

• * ■ * . ' i . 

• You are taking part in an educational research study which «Ls investigating "how 

much people remember what they read and study. % ' * * ' * 

) ' ... , * 

. Your task is to learn as much as you can (both main ideas and details) from reading 
, a brief history text (in W envelope ) . You will only be allowed to read the text once. 
'After that, ♦there will be « 'test*. It will ask you to write down the main ideas and will 
also ask you to answer specific Questions of detail. 

* \ s ' *♦» 

• At various points in the text, there will be questions on what you have just read. 
You should try answ.ringthe^e questions in your head - do not/write answers tof them. ' 

• Trying to answer thes>qTmstions will help you find out whether you can remember 'the ideas 
in the text. you are reading. , 

Important: once you come upon one of these questions in the text, you may 
if you want look back to the previous page but try nevertheless to answer the 
question beforehand. . v 

Study the text carefully and do not skip ahead. Take a's much time as you need' for 
each page. You will not be allowed to revise at the end. Also, do not take any notes 
and make no marks on the text itself. 

Not all^pupils in thi class will be studying the text in the same way, so do not 
worry if they do something else. Just follow the directions given on this sheet. 

When you finish, write down the number which appears on the chart at the front of 
the room. There will be a space at the end of the text to do this.' Then turn the text 
face down on yoyr desk and wait for the test in silence so that the others can finish. 



1 



Right^notf, please write ybur name here: 

Also indicate whether you are □ male; or □ female and write yo«r teacher's name 
here l ..." , . - 

V / 

Your teacher will tell you when to take the text out and start reading it. * • 



EDUCATIONAL RESEARCH STUQY-II 



v DIRECTIONS 



You are taking part in an educational research stucfy which, is investigating how 
much people remember what they read and study. ' 

Your .task* is to learn*as isuch as you can (both main ideas and details) from reading 
a brief history text (in the envelope J. You will only be allowed to read, the text' once. 
After that, there will be a test., \t will ask you to write down the main' ideas and will 
also ask' you to answer specific questions of detail. 

Important: You should read the text page by page; however after turning a 
page, you may if you -want, look back to the previous page" to revise before going on. 
However, you are only allowed to turn back to the previous page "and not further " 
back than that. 

Study the text- carefully and do not skip ahead. Take as much time, as you need for 
each page. You will, not be allowed to revise at t*he end. Also, do not take any notes 
and make no 'marks on the text itself. ' - ' 



Not all pUpils in the class will be studying the text in th^same way, so do not 
worry. if they do something else. Just follow the directions given on this sheet. 

# When you finish, write down the number which appears on the chart at the front of 
the ro£>m. • There will be a space at the end of the text to do this. Then turn the text 
face down on your desk and wajt for the test in silence, so that the otfiers can finish. 




Right now, please write your name' here: 



Also indicate whether you are □ male; or' Q female. ami write your teacher's nai 

here: ...... ' ' 

«... 

Your teacher will tell you when to take the text out and start reading it. 



* ' EDUCATIONAL- RESEARCH STjLJDY-II ' . * 

• " • /f , • . ^DIRECTIONS - '\ ■ ' ' ' - 

• > ' * * 

♦ . ' © ' * r 

" * * ' , + fc - 

r . . I . 

, * * 

r>, . You are taking pact, in an 'educational research study which is investigating how 
much -people? remember what ^they read and study, > 

Your task .is to learn as'-much as % you can (bo^h main .ideas and details) from reading 
a brief history tex't (in* the envelope). 'You will .only be allowed to read the text once. '* 
After that, there will be a test. It will ask you to write down the main ideas and wiM 
also ask^you to. answer .specif ic^ questions of detail. 

' At various joints in the text, there will be questions on what you h^ve just reaoVJ * 

• You should try answering these questions in your head - do not write answers to them. ' 

. \ ^ : 

Trying to answer .these questions will .help you find out whether you can remember the ideas 
in the text you are Reading. fi * ' m . I * 

Important: once you pom| upon one <5f these, questions in the text, you are not 
allowed tt>* turn back to^ the previous page. 

Study the text carefully and do ;iot s kip ahead. Take as much time as you need for 
each page. You will no-t be allowed to revise at 4 the end. Also, do not take^ any notes 
a?nd make no 'marks on the text itself. , * 

4 , M * ' 

Not all pupils in the class will be studying the text in the same way /so do not 

worry if^they do something el sej. Just follow the directions given on this sheet. 

When you finish, write down the number which appears^on >ttie chart at the front of 
•the room. There will be' a space at the end of the text to do this. Then turn the text 
face down on your desk and ^ait for the test , in silence, so tha<t the others can 'finish. 



" 1 



Right now, please writ^»your name hei>e: 

. Also indicate whethei^you'are Q male; or □ female and write your teacher's name 
here: , # * # mm # # . *' ' 

Your teacher will tell you wtfen to take the text- out and start reading it. 

' ' I * 

ERIC ' : . • 15 : - 
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EDUCATIONAL RESEARCH STUDY- II 



_DI RECTI ONS 



, You.-are taking part in an educational research study which is investigating *6w 
much people ^remember what they read and study. * . 

Your task is to learn as much as you can (both main ideas and details) from reading 
a brief history text (in the' envelope ) . You will only be allowed to read the text onc&. 
^After that, there wiil>e a test. It will *sk you to write down the main ideas and wili 
also .ask you t§ answer specific questions of detail. 

* p 
* 

Important: You sho.uld read the text page by page and after turning a page, 
you are not allowed to look back at it afterwards. 

Study the text carefully and do not skiV ahead. ■ Take as much time as you need for' 
each page. You will not be allowed -to ' revise at the end. Also, do not. take any'notes 
and make no marks on the text itself. 



Nol 



>t' all pupils in the 'class will be studying the text in the same way, so do not " 
worcy if they do something else.* Just follow the directions givenon this sheet. 

t ' When you finish, write down the number which appears on the chart at the front of' 
the room. There will be a space at the end of the tex^to do this.. Then turn the text • 
face down on your desk and wait for the test In silence so that the others can finish. 



Right now, please write your name here: y 

Also^indicate whether you are □ male; or □'female and write your teacher' 
here: . ... * v 



c - - - s name 



Your teacher will tell you when to Uke the text out and start reading it. 



